pydev debugger: starting
Building [1, 2, 3, 4, 5, 6, 7, 8, 9, 10]-Gram Models
Computing Perplexities of Test Data, using 1-Gram Model
Perplexity without smoothing of Test Data using the 1-gram English Language Model is: 18.0897705664
Perplexity without smoothing of Test Data using the 1-gram Spanish Language Model is: 21.4930272081
Perplexity without smoothing of Test Data using the 1-gram German Language Model is: 20.4374792775

Perplexity with Laplace smoothing of Test Data using the 1-gram  English Language Model is: 18.0882592283
Perplexity with Laplace smoothing of Test Data using the 1-gram  Spanish Language Model is: 22.0132797752
Perplexity with Laplace smoothing of Test Data using the 1-gram  German Language Model is: 20.9528461374

Perplexity with Backoff  of Test Data using the 1-gram  English Language Model is: 18.0897705368
Perplexity with Backoff  of Test Data using the 1-gram  Spanish Language Model is: 21.4930272051
Perplexity with Backoff  of Test Data using the 1-gram  German Language Model is: 20.4374792479

Perplexity with Backoff smoothing of Test Data using the 1-gram  English Language Model is: 18.0882592283
Perplexity with Backoff smoothing of Test Data using the 1-gram  Spanish Language Model is: 22.0132797752
Perplexity with Backoff smoothing of Test Data using the 1-gram  German Language Model is: 20.9528461374

Perplexity with Weighted Backoff  of Test Data using the 1-gram  English Language Model is: 18.0897705368
Perplexity with Weighted Backoff  of Test Data using the 1-gram  Spanish Language Model is: 21.4930272051
Perplexity with Weighted Backoff  of Test Data using the 1-gram  German Language Model is: 20.4374792479

Perplexity with Frequency Backoff  of Test Data using the 1-gram  English Language Model is: 18.0897705368
Perplexity with Frequency Backoff  of Test Data using the 1-gram  Spanish Language Model is: 21.4930272051
Perplexity with Frequency Backoff  of Test Data using the 1-gram  German Language Model is: 20.4374792479
...........................................................................................

Computing Perplexities of Test Data, using 2-Gram Model
Perplexity without smoothing of Test Data using the 2-gram English Language Model is: 11.0022020272
Perplexity without smoothing of Test Data using the 2-gram Spanish Language Model is: 21.4469402934
Perplexity without smoothing of Test Data using the 2-gram German Language Model is: 19.7388665175

Perplexity with Laplace smoothing of Test Data using the 2-gram  English Language Model is: 11.2300279343
Perplexity with Laplace smoothing of Test Data using the 2-gram  Spanish Language Model is: 23.792166946
Perplexity with Laplace smoothing of Test Data using the 2-gram  German Language Model is: 21.4875984933

Perplexity with Backoff  of Test Data using the 2-gram  English Language Model is: 12.8106662032
Perplexity with Backoff  of Test Data using the 2-gram  Spanish Language Model is: 18.5240266657
Perplexity with Backoff  of Test Data using the 2-gram  German Language Model is: 17.6050940041

Perplexity with Backoff smoothing of Test Data using the 2-gram  English Language Model is: 12.8471546342
Perplexity with Backoff smoothing of Test Data using the 2-gram  Spanish Language Model is: 18.7744122927
Perplexity with Backoff smoothing of Test Data using the 2-gram  German Language Model is: 17.9383954222

Perplexity with Weighted Backoff  of Test Data using the 2-gram  English Language Model is: 11.5527364713
Perplexity with Weighted Backoff  of Test Data using the 2-gram  Spanish Language Model is: 19.2570565693
Perplexity with Weighted Backoff  of Test Data using the 2-gram  German Language Model is: 18.2319149906

Perplexity with Frequency Backoff  of Test Data using the 2-gram  English Language Model is: 11.3017219204
Perplexity with Frequency Backoff  of Test Data using the 2-gram  Spanish Language Model is: 23.3788748491
Perplexity with Frequency Backoff  of Test Data using the 2-gram  German Language Model is: 21.3683942648
...........................................................................................

Computing Perplexities of Test Data, using 3-Gram Model
Perplexity without smoothing of Test Data using the 3-gram English Language Model is: 7.60426218086
Perplexity without smoothing of Test Data using the 3-gram Spanish Language Model is: 13.8307674168
Perplexity without smoothing of Test Data using the 3-gram German Language Model is: 14.5012765308

Perplexity with Laplace smoothing of Test Data using the 3-gram  English Language Model is: 8.92705179122
Perplexity with Laplace smoothing of Test Data using the 3-gram  Spanish Language Model is: 24.6785750582
Perplexity with Laplace smoothing of Test Data using the 3-gram  German Language Model is: 24.27500961

Perplexity with Backoff  of Test Data using the 3-gram  English Language Model is: 9.83687458449
Perplexity with Backoff  of Test Data using the 3-gram  Spanish Language Model is: 17.6378557334
Perplexity with Backoff  of Test Data using the 3-gram  German Language Model is: 16.4611153938

Perplexity with Backoff smoothing of Test Data using the 3-gram  English Language Model is: 10.0984397241
Perplexity with Backoff smoothing of Test Data using the 3-gram  Spanish Language Model is: 17.5104700969
Perplexity with Backoff smoothing of Test Data using the 3-gram  German Language Model is: 16.8967267151

Perplexity with Weighted Backoff  of Test Data using the 3-gram  English Language Model is: 8.60117285311
Perplexity with Weighted Backoff  of Test Data using the 3-gram  Spanish Language Model is: 20.7140022539
Perplexity with Weighted Backoff  of Test Data using the 3-gram  German Language Model is: 18.7056494035

Perplexity with Frequency Backoff  of Test Data using the 3-gram  English Language Model is: 8.96812423003
Perplexity with Frequency Backoff  of Test Data using the 3-gram  Spanish Language Model is: 25.2555653525
Perplexity with Frequency Backoff  of Test Data using the 3-gram  German Language Model is: 23.8089269604
...........................................................................................

Computing Perplexities of Test Data, using 4-Gram Model
Perplexity without smoothing of Test Data using the 4-gram English Language Model is: 4.62357620526
Perplexity without smoothing of Test Data using the 4-gram Spanish Language Model is: 8.40659969621
Perplexity without smoothing of Test Data using the 4-gram German Language Model is: 7.93051251164

Perplexity with Laplace smoothing of Test Data using the 4-gram  English Language Model is: 8.50716510727
Perplexity with Laplace smoothing of Test Data using the 4-gram  Spanish Language Model is: 30.3155744234
Perplexity with Laplace smoothing of Test Data using the 4-gram  German Language Model is: 29.8401090467

Perplexity with Backoff  of Test Data using the 4-gram  English Language Model is: 7.8127769471
Perplexity with Backoff  of Test Data using the 4-gram  Spanish Language Model is: 17.5448461214
Perplexity with Backoff  of Test Data using the 4-gram  German Language Model is: 16.6247120985

Perplexity with Backoff smoothing of Test Data using the 4-gram  English Language Model is: 8.88996685947
Perplexity with Backoff smoothing of Test Data using the 4-gram  Spanish Language Model is: 17.3521877956
Perplexity with Backoff smoothing of Test Data using the 4-gram  German Language Model is: 17.4035195423

Perplexity with Weighted Backoff  of Test Data using the 4-gram  English Language Model is: 6.75708193184
Perplexity with Weighted Backoff  of Test Data using the 4-gram  Spanish Language Model is: 23.6595387267
Perplexity with Weighted Backoff  of Test Data using the 4-gram  German Language Model is: 22.1494390767

Perplexity with Frequency Backoff  of Test Data using the 4-gram  English Language Model is: 8.16394258461
Perplexity with Frequency Backoff  of Test Data using the 4-gram  Spanish Language Model is: 28.2809800011
Perplexity with Frequency Backoff  of Test Data using the 4-gram  German Language Model is: 25.559945645
...........................................................................................

Computing Perplexities of Test Data, using 5-Gram Model
Perplexity without smoothing of Test Data using the 5-gram English Language Model is: 2.96231657404
Perplexity without smoothing of Test Data using the 5-gram Spanish Language Model is: 3.97348269016
Perplexity without smoothing of Test Data using the 5-gram German Language Model is: 3.82182465528

Perplexity with Laplace smoothing of Test Data using the 5-gram  English Language Model is: 10.9445446989
Perplexity with Laplace smoothing of Test Data using the 5-gram  Spanish Language Model is: 33.8157287255
Perplexity with Laplace smoothing of Test Data using the 5-gram  German Language Model is: 35.1428842886

Perplexity with Backoff  of Test Data using the 5-gram  English Language Model is: 6.7259542939
Perplexity with Backoff  of Test Data using the 5-gram  Spanish Language Model is: 17.5979149912
Perplexity with Backoff  of Test Data using the 5-gram  German Language Model is: 16.7463563266

Perplexity with Backoff smoothing of Test Data using the 5-gram  English Language Model is: 8.77705155023
Perplexity with Backoff smoothing of Test Data using the 5-gram  Spanish Language Model is: 17.9526189645
Perplexity with Backoff smoothing of Test Data using the 5-gram  German Language Model is: 18.4198444968

Perplexity with Weighted Backoff  of Test Data using the 5-gram  English Language Model is: 5.99376081985
Perplexity with Weighted Backoff  of Test Data using the 5-gram  Spanish Language Model is: 25.8469763558
Perplexity with Weighted Backoff  of Test Data using the 5-gram  German Language Model is: 24.35671568

Perplexity with Frequency Backoff  of Test Data using the 5-gram  English Language Model is: 7.81615098115
Perplexity with Frequency Backoff  of Test Data using the 5-gram  Spanish Language Model is: 29.014220964
Perplexity with Frequency Backoff  of Test Data using the 5-gram  German Language Model is: 26.207529923
...........................................................................................

Computing Perplexities of Test Data, using 6-Gram Model
Perplexity without smoothing of Test Data using the 6-gram English Language Model is: 2.26287502064
Perplexity without smoothing of Test Data using the 6-gram Spanish Language Model is: 2.09411957526
Perplexity without smoothing of Test Data using the 6-gram German Language Model is: 2.07610096531

Perplexity with Laplace smoothing of Test Data using the 6-gram  English Language Model is: 15.0981175538
Perplexity with Laplace smoothing of Test Data using the 6-gram  Spanish Language Model is: 36.7522158301
Perplexity with Laplace smoothing of Test Data using the 6-gram  German Language Model is: 38.607986086

Perplexity with Backoff  of Test Data using the 6-gram  English Language Model is: 6.22633763542
Perplexity with Backoff  of Test Data using the 6-gram  Spanish Language Model is: 17.5583765647
Perplexity with Backoff  of Test Data using the 6-gram  German Language Model is: 16.8364206612

Perplexity with Backoff smoothing of Test Data using the 6-gram  English Language Model is: 9.11255687543
Perplexity with Backoff smoothing of Test Data using the 6-gram  Spanish Language Model is: 18.8700997278
Perplexity with Backoff smoothing of Test Data using the 6-gram  German Language Model is: 19.5272884851

Perplexity with Weighted Backoff  of Test Data using the 6-gram  English Language Model is: 5.80956192618
Perplexity with Weighted Backoff  of Test Data using the 6-gram  Spanish Language Model is: 26.6606525029
Perplexity with Weighted Backoff  of Test Data using the 6-gram  German Language Model is: 25.4414414388

Perplexity with Frequency Backoff  of Test Data using the 6-gram  English Language Model is: 7.68227542521
Perplexity with Frequency Backoff  of Test Data using the 6-gram  Spanish Language Model is: 29.1359146436
Perplexity with Frequency Backoff  of Test Data using the 6-gram  German Language Model is: 26.4652090451
...........................................................................................

Computing Perplexities of Test Data, using 7-Gram Model
Perplexity without smoothing of Test Data using the 7-gram English Language Model is: 1.92061302216
Perplexity without smoothing of Test Data using the 7-gram Spanish Language Model is: 1.57027215702
Perplexity without smoothing of Test Data using the 7-gram German Language Model is: 1.47796393005

Perplexity with Laplace smoothing of Test Data using the 7-gram  English Language Model is: 19.6741116938
Perplexity with Laplace smoothing of Test Data using the 7-gram  Spanish Language Model is: 38.8053592516
Perplexity with Laplace smoothing of Test Data using the 7-gram  German Language Model is: 40.2394925487

Perplexity with Backoff  of Test Data using the 7-gram  English Language Model is: 6.01167498951
Perplexity with Backoff  of Test Data using the 7-gram  Spanish Language Model is: 17.5547872397
Perplexity with Backoff  of Test Data using the 7-gram  German Language Model is: 16.8512597633

Perplexity with Backoff smoothing of Test Data using the 7-gram  English Language Model is: 9.62253380567
Perplexity with Backoff smoothing of Test Data using the 7-gram  Spanish Language Model is: 19.842786301
Perplexity with Backoff smoothing of Test Data using the 7-gram  German Language Model is: 20.5861488782

Perplexity with Weighted Backoff  of Test Data using the 7-gram  English Language Model is: 5.8624028477
Perplexity with Weighted Backoff  of Test Data using the 7-gram  Spanish Language Model is: 27.0229366048
Perplexity with Weighted Backoff  of Test Data using the 7-gram  German Language Model is: 25.7705702786

Perplexity with Frequency Backoff  of Test Data using the 7-gram  English Language Model is: 7.62870600521
Perplexity with Frequency Backoff  of Test Data using the 7-gram  Spanish Language Model is: 29.2868223473
Perplexity with Frequency Backoff  of Test Data using the 7-gram  German Language Model is: 26.6716935031
...........................................................................................

Computing Perplexities of Test Data, using 8-Gram Model
Perplexity without smoothing of Test Data using the 8-gram English Language Model is: 1.63120337403
Perplexity without smoothing of Test Data using the 8-gram Spanish Language Model is: 1.28063427362
Perplexity without smoothing of Test Data using the 8-gram German Language Model is: 1.3463736105

Perplexity with Laplace smoothing of Test Data using the 8-gram  English Language Model is: 24.0816194996
Perplexity with Laplace smoothing of Test Data using the 8-gram  Spanish Language Model is: 39.9539033006
Perplexity with Laplace smoothing of Test Data using the 8-gram  German Language Model is: 41.0828250554

Perplexity with Backoff  of Test Data using the 8-gram  English Language Model is: 5.91693594948
Perplexity with Backoff  of Test Data using the 8-gram  Spanish Language Model is: 17.5676825423
Perplexity with Backoff  of Test Data using the 8-gram  German Language Model is: 16.8544393981

Perplexity with Backoff smoothing of Test Data using the 8-gram  English Language Model is: 10.2077307773
Perplexity with Backoff smoothing of Test Data using the 8-gram  Spanish Language Model is: 20.7756161223
Perplexity with Backoff smoothing of Test Data using the 8-gram  German Language Model is: 21.5651151085

Perplexity with Weighted Backoff  of Test Data using the 8-gram  English Language Model is: 5.96592105402
Perplexity with Weighted Backoff  of Test Data using the 8-gram  Spanish Language Model is: 27.2104264426
Perplexity with Weighted Backoff  of Test Data using the 8-gram  German Language Model is: 25.8930929582

Perplexity with Frequency Backoff  of Test Data using the 8-gram  English Language Model is: 7.60356509484
Perplexity with Frequency Backoff  of Test Data using the 8-gram  Spanish Language Model is: 29.4338556798
Perplexity with Frequency Backoff  of Test Data using the 8-gram  German Language Model is: 26.6918133153
...........................................................................................

Computing Perplexities of Test Data, using 9-Gram Model
Perplexity without smoothing of Test Data using the 9-gram English Language Model is: 1.49092580621
Perplexity without smoothing of Test Data using the 9-gram Spanish Language Model is: 1.31126487894
Perplexity without smoothing of Test Data using the 9-gram German Language Model is: 1.44837319277

Perplexity with Laplace smoothing of Test Data using the 9-gram  English Language Model is: 27.848299596
Perplexity with Laplace smoothing of Test Data using the 9-gram  Spanish Language Model is: 40.5377647687
Perplexity with Laplace smoothing of Test Data using the 9-gram  German Language Model is: 41.492679763

Perplexity with Backoff  of Test Data using the 9-gram  English Language Model is: 5.87805973116
Perplexity with Backoff  of Test Data using the 9-gram  Spanish Language Model is: 17.5778281751
Perplexity with Backoff  of Test Data using the 9-gram  German Language Model is: 16.8595254742

Perplexity with Backoff smoothing of Test Data using the 9-gram  English Language Model is: 10.8187816726
Perplexity with Backoff smoothing of Test Data using the 9-gram  Spanish Language Model is: 21.6421358867
Perplexity with Backoff smoothing of Test Data using the 9-gram  German Language Model is: 22.4591322932

Perplexity with Weighted Backoff  of Test Data using the 9-gram  English Language Model is: 6.06748384625
Perplexity with Weighted Backoff  of Test Data using the 9-gram  Spanish Language Model is: 27.2958913573
Perplexity with Weighted Backoff  of Test Data using the 9-gram  German Language Model is: 25.9544805583

Perplexity with Frequency Backoff  of Test Data using the 9-gram  English Language Model is: 7.59371668125
Perplexity with Frequency Backoff  of Test Data using the 9-gram  Spanish Language Model is: 29.5785985183
Perplexity with Frequency Backoff  of Test Data using the 9-gram  German Language Model is: 26.7236026349
...........................................................................................

Computing Perplexities of Test Data, using 10-Gram Model
Perplexity without smoothing of Test Data using the 10-gram English Language Model is: 1.41479958173
Perplexity without smoothing of Test Data using the 10-gram Spanish Language Model is: 1.23726077233
Perplexity without smoothing of Test Data using the 10-gram German Language Model is: 1.49637716313

Perplexity with Laplace smoothing of Test Data using the 10-gram  English Language Model is: 30.8070634412
Perplexity with Laplace smoothing of Test Data using the 10-gram  Spanish Language Model is: 40.8466091668
Perplexity with Laplace smoothing of Test Data using the 10-gram  German Language Model is: 41.7206522987

Perplexity with Backoff  of Test Data using the 10-gram  English Language Model is: 5.8647545596
Perplexity with Backoff  of Test Data using the 10-gram  Spanish Language Model is: 17.5832454776
Perplexity with Backoff  of Test Data using the 10-gram  German Language Model is: 16.8626528401

Perplexity with Backoff smoothing of Test Data using the 10-gram  English Language Model is: 11.4265329942
Perplexity with Backoff smoothing of Test Data using the 10-gram  Spanish Language Model is: 22.4386226022
Perplexity with Backoff smoothing of Test Data using the 10-gram  German Language Model is: 23.2737822107

Perplexity with Weighted Backoff  of Test Data using the 10-gram  English Language Model is: 6.15196266342
Perplexity with Weighted Backoff  of Test Data using the 10-gram  Spanish Language Model is: 27.3331128591
Perplexity with Weighted Backoff  of Test Data using the 10-gram  German Language Model is: 25.9845564102

Perplexity with Frequency Backoff  of Test Data using the 10-gram  English Language Model is: 7.60025930195
Perplexity with Frequency Backoff  of Test Data using the 10-gram  Spanish Language Model is: 29.7179186831
Perplexity with Frequency Backoff  of Test Data using the 10-gram  German Language Model is: 26.7266058189
...........................................................................................

 Average Perplexity............................................................................

[0.14720288424209804, 0.17169712779400514, 0.14720288508461254, 0.17169712779400514, 0.14720288508461254, 0.14720288508461254]

[0.625990364593835, 0.6998249242998409, 0.34335033912815716, 0.35659679531638266, 0.4836032661048224, 0.68191778215163]

[0.6218572544218175, 1.0086052415441955, 0.5493861844091144, 0.5325785263244038, 0.8279191749481531, 1.005877028815047]

[0.5686988931947432, 1.2628487465621427, 0.782064790086259, 0.6702722055675281, 1.220198137410246, 1.1918807862664322]

[0.2742138759366487, 1.1473329691343308, 0.9370067473812784, 0.7284417612327485, 1.4317815525305824, 1.260724198000298]

[-0.08182373121521058, 0.9142587627768453, 1.0157494843338426, 0.7450424317900604, 1.500278925261759, 1.2849855161981978]

[-0.2316872322458837, 0.6973999943104925, 1.0511726435186508, 0.7421218784629848, 1.5044000198034464, 1.2984520122225147]

[-0.21693288615022216, 0.5202093890486057, 1.0675188025943594, 0.7292831299640332, 1.4927247851114456, 1.3046340045395048]

[-0.07868066426236653, 0.38710360303298463, 1.0745503463438828, 0.7118860650472048, 1.4785962272464839, 1.3089779698856923]

[-0.03901446088051774, 0.29266604185445644, 1.0770632533589048, 0.6931174920081107, 1.466029471706506, 1.310522498822861]

 Average Descrimination Power............................................................................

[1, 1, 1, 1, 1, 1]

[1, 1, 1, 1, 1, 1]

[1, 1, 1, 1, 1, 1]

[1, 1, 1, 1, 1, 1]

[1, 1, 1, 1, 1, 1]

[-1, 1, 1, 1, 1, 1]

[-1, 1, 1, 1, 1, 1]

[-1, 1, 1, 1, 1, 1]

[-1, 1, 1, 1, 1, 1]

[0, 1, 1, 1, 1, 1]

